Adaptive Mixture Importance Sampling
نویسنده
چکیده
Importance sampling involves approximation of functionals (such as expectations) of a target distribution by sampling from a design distribution. In many applications, it is natural or convenient to use a design distribution which is a mixture of given distributions. One typically has wide latitude in selecting the mixing probabilities of the design distribution. Furthermore, one can reduce variance by drawing xed sized samples from the components of the design distribution, rather than drawing a random sample from the mixture. Here, we investigate the optimal allocation of sample sizes to each component and the optimal mixing probabilities. As the optimal choices involve typically unknown quantities, a two stage procedure is proposed which makes use of a pilot sample for estimating the allocation of sample sizes. After the nal samples are available, optimal mixing probabilities can be obtained for each functional of the target distribution which is of interest. Applications are given to some problems in Bayesian nonparametric logistic regression.
منابع مشابه
Adaptive importance sampling in general mixture classes
In this paper, we propose an adaptive algorithm that iteratively updates both the weights and component parameters of a mixture importance sampling density so as to optimise the importance sampling performances, as measured by an entropy criterion. The method is shown to be applicable to a wide class of importance sampling densities, which includes in particular mixtures of multivariate Student...
متن کاملAdaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation
This paper presents the R package AdMit which provides flexible functions to approximate a certain target distribution and it provides an efficient sample of random draws from it, given only a kernel of the target density function. The core algorithm consists of the function AdMit which fits an adaptive mixture of Student-t distributions to the density of interest via its kernel function. Then,...
متن کاملA Class of Adaptive Importance Sampling Weighted EM Algorithms for Efficient and Robust Posterior and Predictive Simulation
A class of adaptive sampling methods is introduced for efficient posterior and predictive simulation. The proposed methods are robust in the sense that they can handle target distributions that exhibit non-elliptical shapes such as multimodality and skewness. The basic method makes use of sequences of importance weighted Expectation Maximization steps in order to efficiently construct a mixture...
متن کاملA Class of Adaptive EM-based Importance Sampling Algorithms for Efficient and Robust Posterior and Predictive Simulation
A class of adaptive sampling methods is introduced for efficient posterior and predictive simulation. The proposed methods are robust in the sense that they can handle target distributions that exhibit non-elliptical shapes such as multimodality and skewness. The basic method makes use of sequences of importance weighted Expectation Maximization steps in order to efficiently construct a mixture...
متن کاملAdaptive Multiple Importance Sampling
The Adaptive Multiple Importance Sampling (AMIS) algorithm is aimed at an optimal recycling of past simulations in an iterated importance sampling scheme. The difference with earlier adaptive importance sampling implementations like Population Monte Carlo is that the importance weights of all simulated values, past as well as present, are recomputed at each iteration, following the technique of...
متن کاملComputing Normalizing Constants for Finite Mixture Models via Incremental Mixture Importance Sampling (IMIS)
This article proposes a method for approximating integrated likelihoods in finite mixture models. We formulate the model in terms of the unobserved group memberships, z, and make them the variables of integration. The integral is then evaluated using importance sampling over the z. We propose an adaptive importance sampling function which is itself a mixture, with two types of component distrib...
متن کامل